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ABSTRACT 

The New Youth Initiatives in Apprenticeship Program 
(YAPO was compared with the Youth Career Development Program (YCD). 
Data for 1979 and 1930 came from an evaluation of YAP projects by 
CSr; Incorporated, and an evaluation of the YCD projects by the 
Educational Testing Service. A multiple regression approach was used 
to compare student characteristics, effects of participating in YCD 
and YkP, and effects of participation on a variety of outcomes. Due 
to program focuses, YAP and YCD had different client groups. YAP 
clients were predorain&::tly male and white, YCD clients—female and 
black. YAP participants were likely to have a substantial advantage 
in obtaining employment. Analyses indicated participants' s^x and 
race were more strongly associated with employment outcomes than 
differences in program impact. YAP and YCD participants with 
employment Cixperience exhibited relatively high job satisfaction 
scores and the lowest level of satisfaction with their pay. YAP 
participation did seem to lead to greater job satisfaction. 
Supervisors of both groups appeared to give approximately equal 
ratings to participants. Comparative analyses did not provide strong 
evidence of program impact by either demonstration concept, nor did 
comparisons reveal. ^harp differences in program impacts. (Nineteen 
data tables are provided* > (YLB) 



********************1c **************** **************** 

* Reproductions supplied by EDRS are the best that, c^an be made * 

* from the original document. / • * 
*********************************************************************** 



on! 

rxji 

r- I 

rvl 



SUPPLEMENTARY REPORT 



U S. DEPARTMENT OF EDUCATION 
NATIONAL INSTITUTE OF EDUCATION 

EDUCATIONAL RESOURCES tNFORMATlON 
CENTE^^ »ERlC) 
This docuffent las been feproduced as 
fece»\e<l tfOm the pefM)'> or organization, 
or ginat(n<} tt 

Mtno' Changes h,iv« been mdde to improve 
reproduction quairy 

> Points of view Of Opinions sMtetJ m this docu 
cn^ni do not necessdnty represent official NIE 
posilK>ri or polic/ 



COMPARISON OP OUTCOiMES FOR 
YOUTH APPRENTICESHIP PROJECTS AND 
YOUTH CAREER DEVELOPMENT PROJECTS 

Contract No, 99-9-2224-33-57 
April 1982 



Prepared for 

Employment and Trainir.g Administration 
U.S. Department of Labor 
Washington, D.C. 



■PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERlCr 



Prepared ^by 

James M. Richards, Jr., Gerald D. Williams, 
and Edward F. Davin 
CSR, Incorporated 
Suite 500 
805 15th Street, N.W, 
Washington, D.c, 20005 



^ This report was prepared under a contract with the Office of 

(j^ Youth Programs of the Employment and Training Administration, U.S. 
K Department of Labor. Organizations undertaking such proje^cts 

under government sponsorship are encouraged to, state their finA-- 
ings and express their j.udgments freely. Therefore, points of 
^ view or opinions stated do not necessarily represent the official 
position of the Department of Labor. 



.CSR, Incorporated. 



TABLE OF ^CONTENTS ^ 



Page No> 



Chapter 1: Introduction and Background 1 

Chapter 2: Procedure Used to Make Comparisons 5 

Chapter 3: Characteristics and Employment Outcomes 

^' for Total Comparison Groups 16 

Chapter 4: Employment Outcomes for YCD and YAP Participants 

With Some Smployinent Experience 30 

Chapter 5: Job Satisfaction Scales and Supervisor 

Ratings of YCD and YAP Participants 40 

Chapter 6: Summary and Conclusions 47 



Appendix A: List of Reports on the YAP and YCD Demonstrations . • 52 



CHAPTER 1 
INTRODUCTION- AND BACKGROUND 

High rates of unemployment among young people/ especially those from 
disadvantaged groupSf have been a persistent problem in the United States. 
One way devised to attack this problem has been to attempt to improve the 
school-to-wbrk transition. AccJordingly , the desire to effect improvement in 
this area has given rise to a variety of programs and approaches. The range 
of programs operating in this area include vocational education, cooperative 
education/ career education, and varied programs implemented under the Youth 
Employment Demonstration Projects Act of 1977. 

The impetus for the present report grows out of a desire on tlhe part of 
the Office of Youth Programs (CYP) of the U.S. Department of Labor \o make 
available comparative information on different school-to-work interver^tions. 
Specif ically, this report summarizes an effort to compare the New Youth, Ini- 
tiatives in Apprenticeship Program (YAP) with the Youth Career Develooment 
Program (YCD) . Data for this comparison came from an evaluation of the YAP 
projects conducted by CS'^, Incorporated (CSR) and from an evaluation of the 
YCD projects conducted by the Educational Testing Service (ETS).* To maxi- 
mize comparability, data analyses were restricted to YAP and YCD demonstra- 
tions conducted in 1979 and 1980. 



*A list of the CSR and ETS reports on the YAP and YCD implementations, 
respectively/ is provided in Appendix h at the end' of this report. 
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Althougn YAP and YCD both involved efforts to iniprove the school-to-work 
transition, there were differences in the scope of the YAP and YCD imp. emen- 
tations* These differences reflected, in part, differences in orientation* 
The YCD demonstrations had an instructional focus, e.g., instruction in 
career decisionmaking, job seeking skills, etc. Also, YCD demonstrations 
involved both in-school and out-of-school programs. Some of the YCD demon- 
strations seem to have involved a work component while others did not. 
FinallV/ some of the YCD demonstrations were directed at particular target 
groups, e.g», women, Spanish-American youth, inner-city youth, and so on. 

3y contrast, the focus of the YAP demonstrations was on employment and 
on-the-job training (CJT) in appr^nticeable occupations. All YAP implementa- 
tions were in-school projects that involved formal registration and employ- 
ment of high school seniors in apprenticeable occupations. Any instruction 
for YAP students in the area of occupational information and career decision- 
making was incidental. Finally, most of the YAP demonstrations involved both 
inner-city and suburban youth, including both economically disa.i'vantaged and 
non-economically disadvantaged students. 

Despite the differences in orientation, the two programs (YAP and YCD) 
iid have some*^ common objectives, increased youth employment in particular. 
Consequently, one criterion for program and policy deliberations by DOL could 
be the relative effectiveness of the different interventions in increasing 
youth employment. For example, a positive outcome in terms' of employment 
might be defined in terms of the career potential of the occupations in v/nich 
the participants were employed, the number of hours worked, hourly wages, or 
all three. 
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In a more generic sense, the different demonstrations alco shared a 
common objective in that thoy all were designed to help ease the transition 
of youth to the world of wor]<# For the in-school demonstrations, the focus 
would be on the transition from school to work. For the out-of-school dem- 
onstrations, the focus would be on the transition from unemployment or under- 
employment to full-time work, or from one type of wock to another. Conse- 
quently, the different demonstrations also might be compared on measures of 
participants' perceptions of how helpful the demonstrations have been in 
easing the problems of transition, e.g., measures of satisfaction with the 
projects, measures of job satisfaction, etc. Thus, evidence of impact, if 
any, on employment is not the only criterion upon which demonstrations should 
be compared, father, for DOL program and policy purposes the YAP and YCD 
demonstrations should be compared on as many criteria as possibJ e (within the 
constraints of the ETS and GSR data) . 

Fortunately, several of the outcome variables examined in the CSR evalu- 
ation are similar to outcome variables examined in the ETS evaluation. This 
similarity of outcome variables provides the opportunity to conduct the pres- 
ent: comparison study. Both evaluations collected followup dara about current 
employment; weeks and hours-per-week worked; wages (both current and start- 
ing); and stability of employment. Both evaluations also administered job 
satisfaction measures that appear similar. Finally, both studies obtained 
supervisors' ratings that provide roughly comparable measures of actual job 
performance. ' . * . 

At th3 same time, the necessity to limit the analyses to variables that 
were available in comparable form in the CSR and ETS evaluations produced 
considerable selection of cases, and that selection'may have produced groups 



.CSR, Incorporated 



that were considerably different from the samples that were as^d in the pri- 
mary analyses for the two evaluations. Therefore, any discrepancy between 
the results of 'the primary analyses of ETS and CSR and the results of this, 
comparison almost certainly are attributable to such differential selec'.:ion 
of cases. 

For these reasons, the groups used in the analyses for this report will 
be referred to as "comparison groups" rather than as samples. A distinction 
will be made between the "Total Group of Participants" (i.e., those students 
who actually underwent the YCD and YAP experiences) and the "Total Comparison 
Group" (i.e., participants plus students in the control groups). 

In the ETS study, followup data were collected at two points in time, 3 
months and 8 months after each student completed the VCD experience. Because 
the 8-month YCD data are more comparable to the CSR data for 1979 YAP parti- 
cipants and the 3-month YCD data are more comparable for 1980 YAP partici- 
pants, comparisons reported here involve these two follow-up periods. 
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CHAPTER 2 • 
PROCEDURE USED TO MAKE COMPARISONS 

Any comparison that attempts to integrate data from different studies 
must seek a "lowest common denominator" of methodology. In the present zase, 

the characteristics of this lowest common denominator were determined bv 

' ' ^ T 

considering what should be involved in a comparison of YCD and YAP demonstra- 
tions* First, such a comparison should provide information about the extent 
to which YCD and YAP serve different k'inds of students. Second, snqh a com- 
parison should provide information about the effects of participating in YCD 
and in YAP, controlling for differences, if any, in the kinds of students 
served. Third, such a comparison should provide information about the ef- 
fects of participation on a variety of outcomes. 

The designs of the CSR and ETS evaluations most appropriately can be 
described as "quasi-experimental. " Therefore, the most appropriate lowest 
commor\ denominator of methodology appe^:i.ed to be a multiple regression 
approach following the simple conceptual model shown in Figure 2-1. Although 
this diagram could be viewed as a "path model," the statistical procedure of 
path analysis did not appear appropriate for the present comparison. The 
primary interest is in the effects of program participation, especially when 
variation in student characteristics is controlled* Thus, the most appropri- 
ate statistical analysis appeared to be simple multiple regression, treating . 
both student characteristics and measures of program participation as antece- 
dent or "predictor" variables, and outcome 'measures as criterion variables. 
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Figure 2-1. Conceptual Model Underlying Comparison of YAP and YCD[^ 
Deraonstrations • 
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Once the inerhodology had been determinedf the next step involved search- 
ing che dara files from the CSR and ETS evaluations to identify variables 
mat were similar enough to be treated as common variables in parallel mul- 
tiple regressions. The variables identified in this search are listed m 
Table 2-1 and are aescribed in detail below. 

Background Variables 

1* Sex - This student characteristic was treated c.3 a dummy variable 
in which scores of 1_ were assigned to males \nd scores of £ to 
females. This scoring system insures that a positive correlation 
corresponds with the expected direction of most sex bias. 

2. Rac e - This characteristic also was treated as a dummy variable, 
with the scoring system insuring that a positive correlation would 
correspond to the expected direction of any race bias. Scores- of 
1^ were assigned to whites and scores of 0^ to members of other 
races. 

3. Age - Scores were the difference between the year of birth and 
1981. Because students began their participation at about the same 

, age, use of this scoring system should yield an average age for 
1979 participants that is about a year older than the average age 
for 1980 participants. 

4. Family Size - The actual measure of family size used in the present 
comparison was the total number of family menibers including the 
student. This variable, like the next variable, points to some 
important problems that were encountered in attempting to develop 
common variables for the CSR and ETS evaluations. These problems 
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TABLE 2-1 

t 

VARIABLES COMMON TO CSR EVALUATION 01 YAP DEMONSTRATIONS \ 

i 

AND STS EVALUATION OF YCD DEMONSTRATIONS j 

. i 

( 

Background Variables | 

1. Sex , 'I 

2. Race j 

I 

3. Age . - \ 

4. Family Size ^ 
5* Academic Potential 

Parricipation Variables 

6. Parricipation vs. Non-participation 

7. Extenr of Participation 

Outcome Variables 

8. Carrent Employment 

5. Still Employed in First or Apprenticeship Job 
10. Weeks Worked 

j 11. Hours Worked Per Week 

12. Starring Hourly Wage 

13. Current Hourly Wage 

14. Job Satisfaction Ratings 

15. Supervisor P^tings 
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have :.nipiiccitions for the ways in which DOL can work with conrrac- 
cors in developing future evaluations in a way that will facilitate ' 
later integration and comparison of different 'evaluations. Pairaly I 
background r especially family socioeconomi': status , is strongly 
related to many different student outcomes. For example, low i 
school performance and high unemployment are associated with low 
socioeconomic status, particularly if socioeconomic status s low 
enough to justify designation as '^economically disadvantaged.*' 
Consequently, it would seem important to include measures of 
family background and socioeconomic status, at least as control 
variables, in all evaluations like those of CSR and STS. 

Unfortunately, family sise was the only measure oi faaily 
background that could be identified as common to the EtTS and CSR 
eval'aations. The results of social science research generally 
indicate that family size has a weak to moderate association with 
other family background cnaracteristics (for example, there is a 
veak negative relationship between family size and socioeconomic 
status). Therefore family size has enough value as an indicator 
of family background to be included in the present comparison 
study r It must be viewed, however, as a relatively weak ancj 
inefficient indicator. 

The main point of this discussion of the f<»jaily size variable 
is that the present comparison would have been much more rigorous 
and potentially valuable if the CSR and STS evaluations had in- 
cluded a common core of sterns dealing with family background. 
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especially socioeconomic status. Therefore, in planning future 
evaluations, consideration should be given to establishing a common 
core of background items. This common core would be especially 
useful if the items were taken from studies such as the DOL funded 
National Longitudinal Survey or the ^^ational Center for Education 
Statistics national longitudinal studies. If this approach were 
employed, sample survey results could be compared with estimates 
of the population values for the United States as a whole. 
5. Academic Potential - Another important student characteristic 

involves the set of skills, behaviors, aptitudes, etc. that are 
involved in school grades and scores on achievement and aptitude 
tests. "Academic potential" appears to be a relatively objective 
and neutral way of referring to this student characteristic. Both 
the CSR evaluation and the ETS evaluation included a measure of 
academic potential. In the CSR evaluation this measure was the 
student's high school GPA. In the STS evaluation it was the stu- 
dent's score on a specially constructed version of the Sequential 
Test of Educational Progress (STEP) , Reading Test. Although test 
scores typically are highly intercorr elated, it is not legitimate 
simply to transform one of the measures to the metric equivalent of 
the other and use the transformed scores as though they actually 
had been obtain^.d from the other. 

Nevertheless, an effort was made ro develop a measure that 
would yield at least roughly comparable estimates of cicademic 
potential for the two evaluations. This effort involved devel- 
oping a dummy variable in which each measure (grades and STEP 
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scores) vas split at a cutting score corresponding to the aean 

a nationally representative norm group. Students above this., 
cutting score would be assigned a score of 1^ on the dummy variables 
and students at or below the cutting score would be assigned a 
score of 0^ on the dummy variable* 

In the case of grades, this cutting score could be made easily 
and unambiguously by referring to the results of the National Cen- 
ter for Education Statistics' National Longitudinal Study of the 
IJigh School Class of 1972 (although it would have been more rigor- 
ous if the CPA item used by CS^R had been ij^dentical with the G?A 
item used in the national survey). In the case of STEP scores, no 
national norms were available because a special version of the test 
was involved. Therefore, the cutting scoije wa's computed by summing 
rhe item "difficulties" (i.e., percentage of ca^e^ in the norm 
group who answered each item correctly). This procedure would have 
been rigorous if the same norm group had been used for computing 
all item difficulties. Unfortunately, STS took items from STEP 
tests for several different grade levels. Thus, the cutting score 
for the ETS measure of academic potential must be regarded as an 
arbitrary dichotomization that cannot be interpreted as comparable 
to the cutting score for the CSR measure of academic potential. 

Once again, this discussion reemphasizes the desirability of 
comparable (ideally identical) measures when comparing evaluation 
results. Since DOL may wish to compare different sets of evalua- 
tion results/ it would be desirable to use a core of identical 
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items in all evaluations. In the case of academic potential, the 
simplest and most straightforward approach is to include a G?A 
item. 

Participation Variables 

5. Participation - This measure is a dummy variable in which scores 

of i were assigned to student's who actually went through part or 
\ 

all of the YCD and YAP experiences and scores of £ to students in 
the control groups. 

7. Amount of Participation - Not every participant went through the 
entire YCD or YAP experience, and it appeared important to measure 
the actual amount of exposure to these interventions. (In a more 
generic sense, it seemed important to measure the extent to which 
these programs were implemented for each student.) Because the YCD 
demonstrations involved in-school activities, the most appropriate 
measure of amount of participation appeared to be total program 
hours. On the other hand, the most appropriate measure for YAP 
demonstrations appeared to be number of weeks of apprenticeship. 

Outconia»4Aariables 

3. Current Employment - This measure involved a dummy v'ariairle with 
scores, of _1 assigned to students who were employed at the time of 
followup and scores of £ to students who were not employed. Stu- 
dents in the YCD group were classified ^as employed only if they 
were working *full-time" (e.g., 30 hours or more per week), while 
students in the YAP group were classified as employed if they had 
any employment. The original intention was to use any en^Jloyment 
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- for the YCD groups too, but this procedure was precluded by prob- 
lems with the STS data for part-time employment. Since the purpose 

f 

of YCD and YAP was to aid the transition to the permanent labor 
force, being employed at the time of the followup appeared to be a 
more appropriate outcome measure than having been employed at any 
time since, completing YCD or YAP. 

9. Still in First or Apprenticeship Job - This measure also involved 

a dummy variable. For YCD students, scores of 1^ were assigned to * 
students whd were still in the first job they had ofccained after 
completing YCD and scores of 0_ to other students. For YAP stu- 
dents, scores of 1 were assigned to students still in the job in 
which they served, their apprenticeship and scores of 0_ to other 
students. 

10. ^^eeks on Job - Scores involved the number of weeks students had 
worker* on their present or most recent job. 

11. Hours Per Week - Scores involved the number of hours students 
typically worked at their present or most recent job. 

12. Starting Hourly Wage - Score for YCD students was the hourly wage 
they received in their first job after completing YCD. Score for 
YAP students was the salary they received in their apprenticeship 
job. Students who had never received a salary because they had 
never worked were eliminated. 

■• • 

13. Current Hourly Wage - Score was the hourly wage students received 
in their current or most recent job. 

14. Job Satisfaction Ratings - YCD students rated their satisfaction 
with: (a) how the job went, (b) their feelings about their work, 
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(c) pay/ (d) the worthwhileness of their work, and (e) their 
experiences with the YCD program. Ratings were made on three 
category scales, with the alternatives adapted to the characteris- 
tic being rated. For example, the three categories (and rhe scores 
assigned to these categories) for pay were: (1) less than worth, 
(2) about right, and (3) good for job. In all cases, higher scores 
indicated greater satisfaction. YAP students rated* their satis- 
faction with:' (a) pay, (b) opportunity for advancement, (c) 
supervision, (d) recognition for doing a good 'job, (e) on the job 
instruction, and (f ) sense of accomplishment in the job. Ratings 
were made on the following four-category scale: (1) very dissat- 
isfied, (2) dissatisfied, (3) satisfied, and (4) very satisfied. 

15. Work Supervisor Ratings - YCD participants were rated by their 

current supervisor on the following characteristics: (a) puts in 
good day's work, (b) gets along with others, (c) would promote, 

(d) would rehire, and (e) whether their rank compared to that of 
others is satisfactory. These ratings were made on the following 
three-category scale: (1) definitely not, (2) generally, and (3) 
definitely. YAP participants were rated by their current super- 
visor on the following characteristics: (a) work attitude, (b) 
skill level, (c) ability to learn / (d) cooperation, (e) punctual- 
ity, (f) following instructions, (g) relations with co-workers, 
(h) self-initiative, (i) pride in work, and (j) overall job 

per^f ormance. These ratings were made on the following four- 
category scale: (1) poor, (2) fair, (3) good, and (4) excellent. 
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Data from the STp evaluation of the 1980 group were unavailable for the 
present comparison until very late* Therefore^ results for both the ETS and 
the CSR evaluations were analyzed separately by year (i;e»/ 1979 and 1980 )♦ 
This procedure provides a check on the stability of any trends that might 
appear in the data# 
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CHAPTER 3 

CHARACTERISTICS AND EMPLOYMENT OUTCOMES 
FOR TOTAL COMPARISON GROUPS 

The most basic questions asked in comparing YCD and YAP are those that 
pertain to the kinds of students served'by these two programs and the extent 
to which participation in these two programs influenced employment. The 
'first set of analyses for this report examined these issues. 

Tab.le 3-1 summarizes the characteristics of the YCD and YAP Total Com- 
parison Groups on the five background variables and on the percentage of the 
comparison groups who were demonstration participants (rather than in the 
control groups). The results in this table indicate that YCD and YAP served 
different types of students. YCD students were predominantly female and 
non-white (i.e., predominantly black), while YAP students were predominantly 
male and white. Statistical tests of the differences in the proportions of 
whites and males indicated that these differences were highly significant. 

In view of the moderate to strong relationships of race and sex known tc 
exist in the present data, the observed pattern of differences between the 
two groups suggests that YAP participants are likely to have a substantial 
advantage over YCD participants in obtaining employment. It becomes doubly 
important/ therefore, to use a statistical procedure that "controls" for the 
influence of background characteristics when examining the influence of pro-- 
gram participation. The multiple regression procedure used in this study 
provides such a control. When differences exist as large as those bet^^een 
YCD and YAP in Table 3-1, however, "it is dovibtful whether such statistical 
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TABLS 3-1 



CHARACTERISTICS OP COMPARISON GROUPS 
FOR THE YCD and YAP DEMONSTRATIONS 



YCD 



YAP 



1979 1980 
(N=954) (N=517) 



1979 1980 
'(N=493) (N=529) 



% Male 

% White 

A^'^erage Age 

Average 'Family Size 

% Above Cutting Score on Measure 
of Acaderaic Potential 

% of Total Comparison Group 
Who Were Participants 



31.6 
16.9 
18.3 
4.7 



36.0 
13.7 
17.3 
4.9 



87.0 
82.0 
19.3 
4.8 



88.7 
77.9 
18.2 
4.6 



76.7 68.7 



54.9 60.4 



55.6 56.3 



58.4 50.3 



Note - The Total Comparison Group includes both participants and members of 
the control group. 
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controls really equate the two groups. In other words, comparing YCD and 
YAP may resemble the proverbial comparison of apples and oranges, and no 
amount of statistical sophistication can be completely successful in convert- 
ing the two into a comparable form of fruit. On the other hand, the average 
ages and family sizes of YCD and YAP participants are roughly comparable. 
The differences in academic potential are more likely to reflect differences 
in the measures rather than genuine differences between the groups. 

Table 3-2 summarizes the results of an analysis ^of the relationship of 
the background characteristics to participant versus control status, and pro- 
vides a check on the extent to which the YCD and YAP had control groups that 
were comparable to their participant groups. This table also illustrates the 
format that will be followed in all subsequent regression tables for this re- 
port. There are three elements in this ,format. The first is the zero-order 
correlation between each antecedent variable and the outcome variable in 
qu6stion (in Table 3-2, being a participant). The second element consists of 
the standardized (partial) regression weights*. Any given standardized weight 
can be interpreted, roughly, as the correlation between that antecedent vari- 
able and the criterion when the other antecedent variables are held constant. 
The final element consists of the metric (i.e., "unstandardized" or "raw 
score") regression weights. Any given metric weight can be interpreted as 
the amount of change in the criterion that would be produced by one unit of 
change in that antecedent variable when the other' antecedent variables are 
held constant. When the criterion is dichotomous/ as is the case in Table 
3-2/ the metric weight can be interpreted^ very roughly ^ as the change in the 
probability of being in the top group of the dichotomy that would be produced 
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TABIiS 3-2 

HSLATIONSHIP OF- BACKGROUND CHARACTERISTICS 
1^0 PARTICIPANT VERSUS THE CONTROL STATUS 



Zero-Order Regression Weights 

Correlations Standardized Metric 



1979 1980 1979 1980 1979 1980 



YCD ' 


(N=954) 


(N=517) 












Sex 


.02 


.06 




.02 


.07 


• 020 


• 072 


Race 


-.09 


-.16 




-.08 


-.17 


-.111* 


-.244^ 


Age 


.01 


-.06 




.00 


.08 


.000 


. -.062 


Pamily Size 


-.01 


.01 




-.01 


-.01 


-.003 


-.002 


Academic Potential 


-•07 


.04 




-.06 


.04 


-•073 


• 045 


Multiple 


r .11 


.19 












YAP 


/N=»49?) 


(N=«529) 












Sex 


.05 


-.03 




.06 


-.03 


• 083 


-.051 


Race 


.03 


-.oi 




.02 


-.01 


.026 . 


-•016 


Age 


-•07 • 


.04 




-.06 


.04 


-•016 


• 014 


Family Size 


•03 


-.02 




• .03 


-.03 


.010 


-.010 


Academic Potential 


• 08 


.07 




.07 


•07 


• 074 


• 073 


Multiple 


r .W 


• 09 













* Metric regression weight at least twice its stauidard error. 
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by one unit of change in that antecedent variabla* A consr^nsus appears to be 
emerging among social scientists and policy researchers that the raetric 
weights provide the best tool for answering the kinds of questions of concern , 
in the present comparison study • Accordingly, the present comparison follows 
convention by testing for statistical "significance" by determining whether 
each oietric weight is at least twice its standard error. 

The results in Table 3-2 suggest that the YCD and YAP control groups 
generally were comparable to the participant groups • The only significant 
bias appears to be that the YCD control group had a larger proportion of 
whites than the YCD participauit group. The implication of this bias for the 
int^^rpretation of subseq^aent analyses which include both participant and con- . 
trol ^groups is unclear. However; the more is^ortant analyses described in 
this report* involved comparison of the YCD participants with the YAP partici- 
pants f and did not involve the control groups associated with the^e two 
groups. Consequently, the racial difference between the YCD participant and 
control groups would have no relevance to those analyses which were based upon 
comparisons between the two partic£pant groups. 

It is an oversimplification to classify a student as a. YCD or YAP "par- 
ticipant" because theoretically participation could range from a single day 
of intervention to completion of the entire program experience. It seems im 
ortant, therefore, to examine variation in the extent of participation in the 
YCD and YAP demonstrations. Table 3-3 sxiramarizes the characteristics of YCD 
and YAP participants , by year of participation, with respect to the background 
variables and the two different measures of amount of participation. Simi- 
larly, Table 3-4 summarizes the regression analysis of the relationships 

9 
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I TABLE 3-3 



CHARACTERISTICS OP MEMBERS OP COMPARISON GROUPS 
WHO PARTICIPATED IN YCD AND YAP DEMONSTRATIONS 



1979 1980 



YCD 



(N=»524) (N=«312) 



% Male 32.4 38.1 

% White 14.9 9.3 

Average Age 1C.3 17.3 

Average Family Size 4.7 4<.9 

% Above Gutting Score on Academxc Potential 74.1 70.2 

Average Number of Hours m Program 110.5 123.9 



YAP 



(N«288) (N=266) 



% Male 88.5 87.6 

% Whit:e 83.0 77.4 

Average Age 19.2 18^3 

Average Family Size ^ ^^'4♦8 4.6 

% Above Cutting Score on Academic Potential 59.0 59#8 

Average Number of Weeks of Apprenticeship 32.3 33.3 
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between background characteristics and anount of participation. These two 
analyses are liraited to raembers of the Total Comparison Groups with seme par- 
ticipation. In other words, the control groups are eliminated from these 
analyses. 

The results in Table 3-3 confirm the differences between YCD and YAP on 
sex and race composition that were revealed m Table 3-1. Therefore, no fur- 
ther comparisons of the YCD and YAP groups with respect to the background 
variables are Included in this report. In general, the regression analysis 
in Table 3-4 indicates little relati' ^ship between the backgro^ind variables 
and amount of participation. There are 20 metric regression weights in Table 
3-4, and it is to be expected tha-L one of these weights would be "significant" 
at the .05 level through chance alone. Hence, little importance can be at- 
tached tc the single metric weight that is more than twice its standard error. 

Table 3-5 summarizes the outcome measures that were analyzed for the 
coapariStms reported in this chapter. T^o outcomes were used as criteria in 
regression analyses in which simple program participation was used as the 
relevant antecedent variable, namely current e'nployment and current (or most 
recent) hourly wage. The hourly wage analyses are restricted to those who 
had received an hourly wage at some time, or, in other words, to those who 
had some employment experience. Current employment also was used as the 
criterion in regression analyses in which amount of program experience was 
the relevant antecedent varitible. 

The results in Table 3-5 reveal a substantially lower employment rate 
and a somewhat lower pay rate for YCD participants*. It is tempting to inter- 
pret these differences as indicating that programs , such as YAP, that focus 

•# 
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TABLE 3-4 

RSLATIONSHIP OP BACKGRDUJID CHARACTERISTICS TO AiMOUNT OF PARTICIPATION 
AMONG THOSE IN COMPARISON GROUPS WITH SOME PARTICIPATION 



Zero-Order 
Correl-arions 



Regression Weights 



Standardized 



Metric 





1979 


-^•980 


1979 


1980 


1979 


1980 


YCD 


(N=524) 


{N=»312) 










Sex 


-.04 


-.03 


-.04 


-.03 


-8.504 


-10.216 


Race 


.01 


-.08 


.01 


-. 08 


3^430 


-37.474 


Age 


-•03 


• 13 


-.03 


.11 


-4.448 


26.913 


Fanily Size 


. 08 


• 03 , 


* .08 


.00 


3^172 


0.319 


Academic Potential 


. 08 


-.15 


• 08 


-.14 


17.604 


-44^888 


Multiple 


r .12 


.21 






• 




YAP 


{N=272) 


(N==257) 






r 




Sex 


«08 


.07 


.08 


.07 


5S849 


4.265 


Race 


-.08 


.00 


-•07 


.01 


-4^,281 


0^714 


Age 


.03 


.03 


.01 


• 04 


o:i28 


1^160 


Family Si 26 


.03 


• 06 


.05 


.07 


0^708 


.•893 


Academic Potentictl 


-.13 


-.06 


-•12 


-•07 


-5^606 


-2^849 


Multiple 


r .17 


•12 











* Metric regression weight at least twice its standard error. 
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TABLE 3-5 

SUMMARY OF OUTCOME MEASURES FOR TOTAL COMPARISON GROUP 
AND TOTAL GROUP OF PARTICIPANTS 



% of Total Comparison Group Working 
Full -Time 

Current Hourly Wage for Members 

of Total Comparison Group With 
Some Employment 

% of Participants Working Full-Time 



1979 
25.0 . 

3.69 
26.2 



YCD 



1980 
31.1 

3.84 
31.4 



YAP 



% of Total Comparison Group Currently 
Employed 

Current Hourly Wage for Members 

of Total Comparison Group With 
Some Employmenr 

% of Participants Currently Employed 



1979 
85.5 

4.98 
87.2 



1980 
83.8 

4.09 
84.6 



Note: The Total Comparison Group includes both participants and members of 
the control group. 
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specifically on employment are more likely to succeed in furthering employ- 
ment. The temptation to make this interpretation should be resisted. The 
observed differences in employment patterns are more likely to be the conse- 
quence of differences in sex and race composition rather than differences in 
program impact. Most of the YAP group who are employed at all are employed 
full-time, so variation in the definition of current employment probably> had 
relatively little influence. 

The regression analysis relating participation vs, control group status 
to current employment is .summarized in Table 3-6; the regression analysis 
relating participation to current wages is in Table 3-7; and the regression 
analysis relating amount of participation to current employment is in Table 
3-8. These tables provide general confirmation of the fact that* males and 
whites have an advantage in terms of both ei4>loyment and pay, but almost no 
evidence for any impact of participation in YCD and YAP on these outcomes. 
The only metric weight exceeding twice its standard error had the opposite 
sign from the same (nonsignificant) regression weight in the other year. In 
the absence of evidence that either YCD or YAP had any impact on employment 
outcomes it is meaningless to try to compare their outcomes. 

These generally negative results should not be interpreted, however, as 
invalidating the more positive results reported in both the CSR evaluation of 
YAP and the ETS evaluation of YCD. In both evaluations the selection of cases 
and the choice of variables werejor iented to the specific purposes of the YCD 
and YAP demonstrations rather than to finding a lowest common denominator of 
methodology in order to attempt comparisons. For example, the YAP evaluation 
found that positive outcomes were strongly associated with demonstration 
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TABLE 3-6 

RELATIONSHIP OF BACKGROUND VZiRIABLES AND PARTICIPATION 
TO CURRENT EMPLOYMENT FOR TOTAL COMPARISON GROUP 



Zero-Order 
Correlations 
1979 1980 



Regression Weights 



Standardized 



1979 



1980 



Metric 



1970 



1980 



YCD 



Sex 

Race 

Age 

Family Size 



Participation 



(N=954) (N=517) 
.08 .12 



• 06 
.07 
.06 



Academic Potential -.03 



• 03 



Multiple r .15 



• 17 
-.01 
-.04 

.00 
.01 

• 21 



.08 
.07 
.06 
.09 
► 03 
.03 



.12 

.17 
-.01 

.00 
-.02 

.03 



.070* 
. 083* 
.041 
-.016* 
-.036 
.029 



.114* 
• 229* 
-.010 
-.000 
-.016 
.026 



YAP 



Sex 

Race 

Age 

Family Size 
Academic Potential 
Participation 



(N=493) (N=439) 
.11 -.01 



.07 



• 08 

• 06 



.25 



•12 -•OS 
.01 -.03 



Multiple r .20 



• 15 

• 02 

• 28 



.11 

• 04 
.13 
.00 
.09 

• 05 



.02 
.24 
.01 
.03 
.13 
.02 



.113* 

.037 

.024* 

.001 

• 065 

.038 



-.024 

.209* 
-.003 
-•007 

• 098* 

• Oil 



♦ Metric regression weight atdeast twice its standard error. 



29 



.CSR. Incorporofed 



TABLE 3-7 

REIiATIONSHIP OP BACKGROUND CHARACT^IRISTICS AND PARTICIPATION 
TO CURRENT WAGES FOR MEMBERS OP TOTAL COMPARISON GROUP 
WITH SOME EMPLOYMENT 



Zero-Order 
Correlations 



Regression Weights 



1979 



1980 



Standardized 



1979 1980 



Metric 



.a979 



1980 



Sex 

Race 

Age 

Pamily Size 
Academic Potential 
Participation 



(N=340) (N=269) 
.25 .13 



.09 
.04 
-.03 
.10 
.02 



Multiple r .28 



• 02 
.10 
-.06 
-.04 
-.05 
.21 



.24 
.09 
. 02 
-.01 
.08 
.02 



.12 

• 00 

.09 
-.07 ' 
-.03 
-.05 



.458* 
.217 
.035 
-.003 
.177 
.036 



.232* 
.009 
.153 
-. 018 
-.063 
-.096 



YAP 



Sex 

Race 

Age 

Family Size 
Academic Potential 
Participation 



(N=406) (N=388) 
' .24 .15 



.06 
.06 
.02 
.02 
• 04 



Multiple r ^25 



.06 
-•08 
-.04 
-•04 
-.04 

.19 



.24 
.04 
.00 
• 04 
.03 
.03 



.14 
.05 
-.07 
-.031 
••04 
-•03 



1.275* 

• 174 
-.001 

• 037 
.088 
.096 



.479* 
.128 
-.055 
-.023 
-.077 . 
-.063 



♦'Metric regression weight at least twice its standard error* 



TABLE 3-8 

RELATIONSHIP OF BACKGROUND VARIABLES AND AMOUNT OF PARTICIPATION 
TO CURRENT Ef^PLOYMENT FOR TOTAL GROUP OF PARTICIPANTS 



Zero -Order 
Correlations 



Regression Weights 



Standardized 



Metric- 





1979 


1980 


1979 


1980 


1979 


1980 


YCD 


(N=524) 


(N=312) . 










Sex 


.09 


< .12 


.10 


.12 


.089* 


.117* 


Race 


• 05 


.14 


.06 


.13 


.079 


.20* 


Age 


.03 


-.03 


.03 


-.02 


.020 


-.018 


Family Size 


.09 


08 


.10 


-. 06 


.018* 


-.012 


Academic Potential 


.03 


-.06 


.01 


-. 06 


.008 


-.063 


Total Program Hburs 


.07 


-.03 


.07 


-.02 


.000 


.000 


Multiple 


r 












YAP 




(N=228) 










Sex 


.07 


-. 08 


.08 


-.10 


.083 


-.111 


Hace 


.06 


.26 


.03 


.24 


.023 


.207* 


Age 


.14 


-.06 


.16 


-. 02 


.022* 


-.013 


Family Size 


-.04 


-.09 


-.06 


-.10 


-.012 


-.023 


Academic Potential- 


.10 


-.19 


.13 


.19 


.089 


• 142* 


Weeks of Appren- 
ticeship 


-.03 


.10 


- -.02 


.12 


-.003 


» 

.002* 


Multiple 


r .21 


.36 











* Metric regression weight at least twide its standard error • 
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characteristics / whereas the present comparison study combined data frcm 
demonstrations that varied substantially in their impact on outcomes. The 
positive results obtained in the CSR and STS evaluations probably should be 
interpreted as correct, and the inconclusive results obtained here as the 
consequence of using a lowest common denominator methodology* 



CHAPTER 4 

SMPLOYMENT OUTCOMES FOR YCD AND YAP PARTICIPANTS 
SOME EMPLOYMENT EXPERIENCE 

The contingencies of data collection in the CSR and ETS evaluations made 

♦ it inevitable that data on some outcome variables would be missing for one or 

» 

both groups. Similarly / scxae variables, such as continuation in the first or 
apprenticeship job, by definitio.* are available only for students with some 
employment. Thus, several of the analyses were restricted not only to parti- 
cipants but also to participants' who had been employed at some time^'s^ce 
completing their participation. Such analyses are presented in this chapter. 
These analyses also used amount of participation as the relevant measure in 
the regression analyses. 

Table 4-1 summarizes the various overall outcomes. Limiting the analysis 
to participants with some employment markedly increased the proportion of the 
YCD group currently working (full-time), but this trend did not eliminate the 
difference between YCD and YAP. Although the control groups have been elim- 
inated, it still appears more reasonable to attribute this difference to dif- 
ferences in race and sex composition of the YA? and YCD demonstrations rather 
than to differences in program impact. 

The number of weeks on the job, number of hours worked per week, and 
starting hourly wage are lower for YCD participants than for YAP participants. 
Conversely, the proportion of the YCD participants still in their first job is 
higher than the proportion of YAP participants still in their apprenticeship 
job. These data hint at the possibility that attrition over time (as re- 
flected in the 1979-1980 differences) is greater for YAP participants. This 
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TABLE 4-1 



SUMMARY OF AMOUNT OP PAKTICIPATION 


AND OUTCOMi: 


MEASURES 




FOR PARTICIPANTS OTTH SOME 


EMPLOYMENT 










YCD 






1979 
(N=238) 




1980 
{N=«168) 


Average Number of Hours* in Program 


109,8 . 




125.8 


% of Participant Group Working Full-Tiine 


61.3 




59.5 


% Still in First Job 


61,3 




71.4 


Average Number of Weeks on Job 


13 ,8 




14.0 


Average Hours Per Week 


34.8 




37.9 


Average Hourly Wage in First Job 


3*35 


^ 


3.43 


Average Current: Hourly Wage 

> 


3*71 


YA^ 


3.80 




1979 
(N=*249) 




1980 
(N=«20 5) 


Average Number of Weeks of Apprenticeship 


32*7 




33.9 


% of Participant -Group Currently Employed 


90*0 




94.6 


% Still in Apprenticeship Job 


42.3 




62.2 


Average Number of Weeks on Job 


57.9 




40 .7 


Average Hours 'Per Week . 


41.5 




40.2 


Average Staurting Hourly Wage . 


3.94 




3.46 


Average Current Hourly Wage 

<* 


5.03 




4.05 

« 
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differencs/ like many other differences observed, soay be attributable to the 
sharp differences in the race and sex composition of the two groups • Addi- 
tionally/ this difference also taay be attributable to the marked differences 
in the role of employment within the structures and processes of the two dif- 
ferent demonsti-ation concepts • 

Table 4-2 sximmarizes a regression analysis for current employment that 
closely parallels the analyses in Tahiti 3-6 and Table 3-8. Although one 
metric regression weight for amount of participation did exceed twice its 
standard error, in general the results in Table 4-2 confirm the results in 
Tables 3-6 and 3-8. That is, little evi'lence was obtained for any consistent 
influence of amount of participation in either YCD or YAP on current employ- 
ment. Certainly, the data presented in Table 4-2 do not provide a basis for 
comparing the impact of these prograims on employment. 

The regression analysis xor continuation in the first or apprenticeship 
job is summarized in Table 4-3; for weeks worked in Table 4-4; for hours per 
veek in Table 4-5; for starting hourly wage in Table 4-6; and for current 
hourly wage in Table 4-7. A few of the metric regression weights presented 
in these- tables exceeded twice their standard error, but these significant 
results are scattered, and do not reveal any strong, consistent associations 
between the antecedent variables and the different criterion variables. 

There are indications that the race and sex ccxaposition of the groups, 
as well as the duration of participation, have some association with the rele- 
vant outcomes. In addition, the assoipiation with outcomes exhibited by the 
demographic characteristics and by the level of participation both appear to 
be saaewhat more consistent for the YAP group. However, it is important to 
reiterate that the statistically significant results included in Tables 4-2 
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TABLE 4-2 

RELATIONSHIP OF ANTECEDENT VARIABLES TO CURRENT E14PL0YMENT 
FOR PARTICIPANTS WITH SO^ EMPLOYMENT 



YCD 



Zero-Order 
Correlations 
1979 1980 



Sex 

Race 

Age 

Fainily Sii:e 
Academic Potential 
Tbtal Program Hours 



(N=238) (N=«168) 
-•02 ♦OS 



-.04 
• 00 
.15 

•T.06 
.11 



Multiple r .20 



.20 
-♦06 
-♦13 
-♦06 
-♦05 

♦ 24 



Regression Weights 



Standardized 



Metric 



1979 



1980 



1979 



► 01 

► 05 
.02 

► 14 

► 07 

► 12 



.01 
♦ 18 
-.04 
-♦10 
-♦08 
-♦05 



-♦012 
-♦059 

♦ 186* 

♦ 028* 
-♦081 

♦ 001* 



1980 



♦ 013 

♦ 288 
-♦038 
-♦024 
-♦081 

♦ 000 



YAP 



Sex 

Race 

Age 

Family Size 

Academic Potential 

Weeks of Appren- 
ticeship 



(N«249) (N=204) 
-♦01 -^03 



♦ 08 

♦ 16 
-♦02 

♦ 08 



-♦07 

Multiple r ^22 



♦ 15 

♦ 05 
-.06 

♦ 08 

♦ 03 

♦ 21 



-♦01 

♦ 07 

♦ 18 
-♦04 

♦ 09 

-♦06 



-♦04 

♦ 16 

♦ 08 
-♦06 

♦ 09 

♦ 04 



-♦008 

♦ 055 

♦ 024* 
-♦008 

.052 

-♦001 



► 029 
.092 
.035 

► 008 
.044 

► 000 



* Metric regression weight at least twice its standard error. 
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TABLS 4-3 

REr*ATIONS^^JP OP ANTECSDEMT VARIABLES TO CONTIJJUATION IN 
FIRST OR A?PRE!^TICESHIP JOB ?0R PARTICIPANTS :^TH SOME EMPLOYMENT 



Zero-Order 



Regression Weights 





Correlations 


Stamdar 


aized 


Metr 


ic 




1979 


1980 


ly / y 


T ft o rt 


1979 


T ft o 

198 U 




(N=t238) 


(N=168) 










Sex 


-.02 


-.03 


-.03 


-.03 


-.034 


-.024 


Race 


-.13 


-.05 


-.13 


-.05 


-.163* 


-.032 


Age 


-.01 


-.11 


-.01 


-.11 


-.007 


-.010 


Family Size 


.07 


.01 


.05 


.01 


.010 


.002 


Academic Potential 


.00 


.09 


.01 


.09 


.006 


.089 


Total Program Hours 


-.02 


.02 


-.01 


.06 


.000 


.000 


Multiple r 


. 15 


.20 










YAP 


(N=»242) 


(N=201) 










Sex 


.07 


.08 


.07 


.07 


.119 


.102 


Race 


.05 


.14 


.03 


.15 


.048 


.180* 


Age 


• 08 


.06 


*08 


.10 


.018 


.090 


Pcuaily Size 


-.02 


.00 


.-.03 


.00 


-.009 


.001 


Academic Potential 


.04 


.15 


.06 


.16 


.058 


.156* 


Weeks of Appren- 
ticeship 


.00 


.01 


.00 

1 


.01 


.000 


.000 


Multiple r 


.12 


.24 











ERIC 



* Metric regression weight at least twice its stsmdard erroz 
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TABLE 4-4 

RELATIONSHIP OF ANTECEDENT VARIABLES TO WEEKS WORKED 
FOR t>ARTICIPANTS WITH SOME EMPLOYMENT 



Zero-Order - Regression Weights 

Correlations Standardized Metric 





1979 


1980 


1979 


1980 


1979 \ 


1980 


YCD 


(N=»206) 


( N=l 24 ) 








J 


Sex 


06 


. 09 


-.06 


. 08 


-1.148 


1.425 


Race 


*01 


.11 


. 01 


.10 


.240 


3. 024 


Age 


-.08 


-.15 


-.07 


-.13 


-1.094 


-2.244 


Family Size 


.10 


-.08 


.09 


-.06 


.391 


-.244 


Academic Potential 


.01 


.05 


.01 


.03 


.156 


.692 


Total Program Hours 


.03 


-.02 


.02 


.01 


• 002 


.001 


Multiple r 


.14 


.21 














i 










YAP 


(N«246) 


(N=204) 










Sex 


.05 


.07 


* .03 


.05 


5.029 


6.475 


Pace 


.03 


.15 


.05 


' .17 


6^488 


17.182* 


Age 


.05 


.09 


.04 


.11 


.•786 - 


8.450 


Family Size 


-.02 


.01 


-.03 


.02 


-•881 


.452 


Academic Potential 


-.02 


' .06 


.01 


.07 


1^188 


. 5.904 


Weeks of Appren- 
ticeship 


.20 


• 10 


' .20 


.09 


• 378* 


•,179 


Mul-tiple r 


.21 


.23 











* Metric regression weight atyleast twice its standard error. 
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i TABLE 4-5 

21ELATI0NSHI? OF ANTECEDENT VARIABLES TO HOURS WORKED 
PER WEEK FOR PARTICIPANTS WITH SOME EMPLOYMENT 



Z'^ro-Order Regression Weights 

Correlations Standardized Metric 



1979 1980 1979 1980 1979 1980 







(N=163) 










Sex 


• 04 


• 07 


. 04 


. 08 


1.165 


1.901 


Race 


— • U3 




-.03 


.05 


-1.198 


1.830 


Age 


• 04 


- 09 


. 03 


.11 


.778 


2. 318 


Family Size 


01 


02 


-. 01 


-.02 


-. 049 


-.117 


Academic Potential 


-•06 


-.05 


-.06 


.06 


2.111 


1.569 


Total Program Hours 


.01 


-.03 


.02 


-.02 


.004 


-.002 


Multiple r 


• 09 


.15 










YAP 


> 

(N=245) 


(N=200) 












.19 


.19 


.17 


.17 


5.094* 


4.323* 


Race 


.07 


.11 


.08 


.11 


1.749 


2.242 


Age 


.08 


.06 


.08 


.07 


.280 


1.051 


Family Size 


-.01 


-.04 


-.02 


-.03 


-.077 


-.130 


Academic Potential 


.00 


-.01 


.04 


.01 


.630 


*167 


Weeks of Appren- 
ticeship 


.17 


.12 


.17 


.10 


.058* 


.042 


I4ultiple r 


.27 


.23 











♦ Metric regression weight at least twice- its standard error. 
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TABLE 4-6 

RELATIONS l^I? OF ANTECEDENT VARIABLES TO HOURLY WAGE 
IN FIRST JOB FOR PARTICIPANTS v^ITH SOME EMPLOYMENT 



Zero-Order' 
Correlations 



1979 



1980 



Regression Weights 



Standardized 



Metric 



1979 



191,0 



1979 



ERIC 



1980 



YCD 
3ex 


(N»70) 
.15 


(N=36) 
• 04 


.14 


.02 


.219 


.025 


Race 


.17 


.02 


.21 


.00 


.401 


.031 


Age 


.14' 


-.16 


.12 


-.16 


.139 


-.155 


Faaily Size 


-.12 


.01 


-.07 


.03 


-.023 


.008 


Academic Potential 


.11 


-•09 


.11 


-.16 


.193 


-.184 


Total Program Hours 


-.12 


-.17 


-.14 


-.18 


-.001 


-.001 


Multiple r 




• 2 / 










YAP 


(N=226) 


(N-193) 










Sex 


.11 


• 11 


.11 


.12 


• .566 


.262 


Race 


• 01 


-•11 


.00 


-.12 


.011 


-.124 


Age 


.05 


-•01 


.04 ' 


-.04 


.026 


-.064 


Family Size 


• 09 


-•01 


.09 


-.01 


.076 


-.003 


Academic Potential 


• 03 


-.03 


.03 


-.02 


.098 


-.039 , 


Weeks of Appren- 
ticeship 


• 04 


.06 


.04 


.06 


.002 


• 002 


Multiple r 


• 16 


• 18 











* Metric regressidh weight at least twice its standard error. 
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TABLE 4-7 

RELATIONSHIP OP ANTECEDENT VARIABLES TO CURRENT HOURLY WAGE 
FOR PARTICIPANTS WITH SOME EMPLOYMENT 



Zero-Order , Regression Weights 



Correlations Standardized • Metric 





1979 


1980 


1979 


1980 


1979 


1980 


YCD 

— ^ 

Sex 


(N=209) 
.26 


(N=163) 
.13 


.26 


.12 


. 533* 


. 242 


Race 


.04 


.06^ 


.06 


. 04 


.159 


.140 


Age 


.00 


.02 


-.03 


.04 


-.044 


.066- 


Family Size 


-. 08 


-.10 


-.07 


-.09 


-.029 


-.043 


Academic Potential 


.11 


-.07 


.09 


-. 08 


. 226 


-.177 


Total Program Hours 


-.04 


-.07 


-.04 


-.09 


.000 


-.001 


Multiple r 


.30 


.20 










YAP 


(N=245) 


(N=202) 










Sex 


.21 


.13 


.21 


.11 


1.167* 


.274 


Race 


.03 


.09 


.02 


.08 


.085 


.158 


Age 


-.02 


-.01 


-.03 


-.02 


-.021 


-.040 


Family Size 


.06 


-.06 


.07 


-.06 


.070 


-.028 


Academic Potential 


.03 


-.05 


.04 


-.03 


.152 


-.057 


V/eeks of Appren- 
ticeship 


.10 


.16 


.09 


.16 


.006 


.007* 


Multiple r 


.25 


.23 










* Metric regression weight at 


least twice its 


Standard 


/I 

error. 
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through 4-7 are scattered with respect to the antecedent variables, the two 
program concepts, and the two years of graduation, and that, consequently, 
no clear pattern can be discerned based upon these results. 

In summary, these results dc ot reveal any clear relationship between 
the relevant outcomes and participation in either YCD or YAP. Therefore, 
the results of these analyses are not particularly enlightening for policy 
relevant comparisons of YCD impact and YAP impact. Once again it should be 
remembered that the primary evaluations of both YAP and YCD yielded more 
positive results. The inconclusiveness of the present results seems to be 
primarily a consequence of the lowest common denominator methodology which 
was enploved in these comparisons, and not a consec[uence of a lack of impact 
by the two individual programs. 
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CHAPTER 5 

JOB SATISFACTION SCALES AND SUPEFVISOR RATINGS 
FOR YCD AND YAP PARTICIPANTS 



The final set of analyses conducted for the present comparison involved 
job satisfaction scales and supervisor ra tings • Like the analyses reported in 
Chapter 4, these analyses were limited to participants with some employment. 
In each instance the analyses were further limited to cases with data available 
for the specific scales cind ratings in question. 

Table 5-1 su mm arizes the overall outcomes with regard to the job satisfac- 
tion scales and Table 5-2 presents the regression analyses for these data. To 
conserve space and avoid information overload. Table 5-2 reports only the results 
for amount of program participation as a predictor of job satisfaction, elimi- 
nating the correlations and regression weights for the background variables. 

The results in Table 5-1 suggest that both YCD and YAP participants' are 
reasonably satisfied with all aspects of their jobs (althougn both groups are 
least satisfied with their pay). When the differences in the job satisfaction 
scales are considered, it seems likely that the absolute level of satisfaction 
is about the same in the two groups. The regression analyses in Table 5-2 
yielded several metric regression weights that exceeded twice their standard 
error • All of these statistically significaiit metric regression weights in- 
volved YAP participants, and some such signif iccint weights were obtained in each 
year. These results suggest, but do not prove, that participation in YAP was 
somewhat more likely than participation in^YCD to lead to greater job satisfac^ 
tion (or perhaps to a job that is inherently more satisfactory). Saae of the ' . 
results of the primary evaluation of YAP are consistent with this conclusion. 
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TABLE 5-1 
AVERAGE JOB SATISFACTION SCORES 
FOR YCD AND YAP PARTICIPANTS 



YCD 



How Job Went 
Peelings About Work 
Pay 

Wcrthwhileness of Work 
Program Experiences 



1979 
(N=189) 

2.38 

2.30 

2.13 

2.35 

2.39 



1980 
(N=142) 

2.35 

2.36 

2.12 

2.46 

2.37 



YAP 



Pay 

Advancanent Opportunities 
Supervision 

Recognition for Good Job 
On-the-Job Training ^ 
Accompli shment 



1979 
(N=280) 

2.66 

2.81 

3.07 

3.01 

3.19 

3.24 



1980 
(N=255) 

2.76 

2.87 

3.10 

2.S8 

3.23 

3.36 
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TABLE 5-2 

RELATIONSHIP OF AMOUNT OF PARTICIPATION 
TO i'dEASURES OF SATISFACTION 



-ERIC- 



Zero-Order 
Correlations 



Regression Weights 



Standardized 



Metric 





1979 


1980 




1979 


1980 


1979 


1980 


YCX) 


(N=189) 


(N=142) 




> 








Satisfaction With 
















How Job Went 


• 06 


-.02 




• 05 


-•08 


• 000 


• 000 


Feelings About Work 


.10 


-•03 




• 09 


-•06 


• 001 


• ooef 


Pay 


• 06 


-•10 




• 07 


-•12 


• 001 


-•001 


Worthwhileness of 
Work 


-• 06 


-• 08 




-• 08 


-•12 


-•001 


• 000 


Program. Experiences 


• U J 


. XU 






• Oo 


• 000 


• 000 


YAP 


(N=280) 


(N=255) 




* 








Satisfaction With 










< 






Pay 


• 03 


.Q7 




.05 


.06 


• 002 


.002 


Advancement 


.10 


.17 




• 12 


.16 


.004* 


.006* - 


Supervision 


.05 


.22 




• 05 


.21 


.002 


.007* 


Recognition 


.05' 


.14 




• 06 


' .14 


.002 

f 


.006* • 


On-the-job Training 


.02 

•J 


• 21* 


I* 


-.04 


.21 


.001 


♦ 008*^ 


Ac c omp lis hment 


^12 


•11 




.12 


• .11 


' .004* 


.004 



* Metric regression weight at least" twice* its standard error. 
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The overall outcoraes for supervisor ratings are summarized in Table 5-3/ 
and the supervisor rating regression analyses are presented in Table 5-4 • 
The overall outcomes suggest that supervisors of both YCD and YAP partici- 
pants are generally satisfied With the participants' work. Since these data 
were based upon random samples of all participants, regardless of current 
employment status, these data provide some evidence of positive impact by 
the programs, as judged by the supervisors of the participants. 

The regression analyses relating amount of participation to supervisor 
rating levels include three metric regression weights which may be considered 
statistically significant. All three of these significant regression weights 
involved YAP participants and all three of them also involved participants 
who graduated from high school during 1980. The difference between the two 
program concepts may be explained by the stronger emphasis of the YAP concept 
on employment. The difference with respect to the years of graduation may 
be attributable to the fact that four of the seven YAP projects* were in the 
initial stages of implementation during the 1973-79 academic year. Other 
data available indicate that both the level and the quality of participation 
were very uneven during that year in the newly implemented demonstration 
pro j ects . 



43 

46 



CSR, Incorporated 



TABLE 5-3 
AVERAGE SUPERVISOR RATINGS FOR 



YAP 



Work Attitude 
Skill Level 
Ability to Learn 
Cooperation 
Punctuality 

Following Instructions 

Relations with Co-workers 

Self Initiative 

Pride in Work 

Overall Job Performance 



YCD AND YAP PARTICIPANTS 












1979 




1980 




(N«50) 




(N=234) 


Puts in Good Day's Work 


2.88 




2.86 


Gets Along With Others 


2.90 




2.93 


Would Promote 


^ 2.76 




2.60 


Would Rehire 


2.86 




2.82 


Rank Compared to Others 


2.62 




2.59 



1979 


1980 




(N=162) 


(N=149) ' 


/ 
./ 

/ 


2.93 
2.78 


2.97 
2.76 


1 
1 

1 

1 

/ 
/ 
/ 

/ 
r 


2.93 


2.99 


1 

/ 

f 

t 


3.12 


3.14 / 

/ 


1 
t 
1 


2.95 


/ 
/ 

2*97 / 

/ 




2.88 


2.94 / 

/ 

/ 




3.10 


/ 

3.28''' 

/ 




2.72 


2^''^0 

/ 








2.88 


/2.88 




2.86 


/ 

/ 2.91 
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TABLE 5-4 

RELATIONSHIP OF AMOUNT OF PARTICIPATION 
TO SUPERVISOR RATINGS 



ERJC- 





Zero- 


-Ordor 




Regression Weights 







Correlations 


Standa 


rdized 


Metric 






1979 


1980 


1979 


1980 


1979 


1980 


YCO 


(N=50) 


(N=284) 










Employer Raiding of: 














Puts in Good Day's 
Work 


.05 


-.05 


.06 


-. 06 


. 001 


.000 


Gets Along With Others . 03 


-.02 


.01 


-.04 


.000 


.000 
- 


Would Promote 


.06 


-.06 


.04 


-.04 


.000 


.000 


Would Rehire 


.06 


-.04 


.07 


-.02 


.001 


.000 


Rank Compared to 
Others 


-.04 


-.01 


-.08 


.01 


-.001 ' 


.000 


YAP 


(N=162) 


(N=149) 










Job Performance 














Rating of : 














Work Attitude. 


.09 


.i2 


.12 


.15 


.005 


.007 


Skill Level 


.07 


.15 


.08 


.17 


.003 


>.007* 


Ability to Learn 


.03 


.16 . 


.05 


.19 


.002 


.007* 


Cooperation 


-.02 


.05 


.01 


.08 


.000 


.004 


Punctuality 


.04 


.05 


. .06 


.09 


.003 


.004 


Following ' Instruc- 
tions 


.00 


.04 


.01 


.05 


.001 


-.002 
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TABLE 5-4 (CONTINUED) 



Relations with Co- 
workers •02 .ll 

Self Initiative .05 .16 

Pride in Work .07 .08 

Overall Job Per- 
formance .07 .12 



.03 
.06 
.09 

.10 



.14 
.17 
.11 

.14 



001 

.003 
.004 

► 004 



• 005 



• OGc 



.005 



.006 



♦ Metric regression weight at least twice its standard error. 
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CHAPTER 5 
SUMMARY AND CONCLUSIONS 

The YAP arid YCD projects differed markedly in program design. YAP 
focused upon employment experience for in-school youth. YCD focused upon 
providing career development information and job^seeking techniques in a 
classroom setting for both in-schoo^f and out-of -school youth. In its ori- 
gins/ the YAP concept was not target- d upon the economically disadvantag.ed. 
3y contrast/ the YCD concept was oriented/ frdta the outset/ toward the 
economically disadvantaged population/ and toward specific sxibsets of the 
economically disadvantaged population with additional barriers to employ- 
men^e These differences in program design primarily account fox the sharp 
differences in the race and sex composition of the YAP and YCD client groups. 
Basically/ the YAP client group was predominantly male and white/ while the 
YCD client group was predominantly female^ and black. 

The analyses pre/sented in this report also revealed some other interest- 
ing features of the YAP and YCD demonstrations. First/ the analyses clearly 
indicate that/ for both the YAP and YCD demonstrations/ the participants* sax 
and race were more strongly associated with the various employment outcomes 
than were either of the measures of program participation. In short/ males 
and whites served by both types of demonstrations fared better than females 
and blacks/ whereas the analyses did not provide conclusive evidence that 
participation in either demonstration had a positive impact upon employment 
outcomes. For the association between race and sex and employment outcomes/ 
and also for the association between participation and employment outcomes/ 

47 



a greater nuaber of statistically significant relationships were observed for 
the YAP demonstrations. 

Participants in the YAP and YCD demonstrations who had some employment 
experience generally exhibited relatively high job satisfaction scores. Both 
groups of participants exhibited the lowest level of satisfaction with their 
pay. For YCD participants, there were no statistically significant relation- 
ships between any of the job satisfaction measures and the level of partici- 
pation. For YAP participants, there were a number of statistically signifi- 
cant relationships between the individual measures of job satisfaction and 
the level of participation. It does' appear, therefore, that YAP participa- 
tion does lead to greater job satisfaction, perhaps by helping participants 
to gain access to and retain employment in somewhat tai^getted (apprentice- 
able) positions that are inherently aore satisfying for the types of 
students involved. , 

In addition to examining differences in job satisfaction scales, this 
study also examined differences in the ratings given to participants by job 
supervisors* in general, the supervisors of both participant groups appeared 
to give approximately equal ratings to the participants. As with the job 
satisfaction scores, there were no statistically significant relationships 
between the individual supervisor rating items and the level of participa- 
tion, for YCD participants. This may be attributable to the lack of an 
emphasis upon en^loyment in the YCD demonstration. For the YAP participants, 
all the statistically si»:/nif icant relationships 'between supervisor ratings 
and level of participation were observed among the participants who graduated 
in 1980, with no significant relationships .for participants who graduated in 
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1979 • This difference by year of graduation may be attributable to the fact 

that four ot the seven operating YAP projects were in the start-up phase of 

operations during the 1978-79 academic year* 

In general/ the comparative analyses presented in this report did not 

provi'ie strong evidence of program impact by either of the demonstration con- 

ceptS/ nor did the comparisons reveal sharp differences in program impact 

between the two different demonstration concepts • It is important to note 

once again/ as has been done at the relevant junctures within €he body of 

this report/ that the absence of evidence in the comparative analyses for 

program x^npact should not be regarded as definitive* This lack of evidence 

of progrcim impact is not consistent with the findings of tr*e tno separate 

evaluations of the YAP and YCD demonstrations/ which examined program impact 

in a much more specific cuid detailed fashion based upon comparisons with 

carefully selected control groups. Therefore/ it may be concluded that the 

V 

relative lack of impact revealed by the analyses presented in this report is 
attributable to the lowest common denominator methodology emplcyed for these 
comparisons* 

The present comparative effort was undertaken despite a relatively high 
level of incompatibility between the demonstrations in three key areas. 
First/ the two demonstrations involved very different treatments* Second/ 
tne two demonstrations served very different client groups* Third/ the 
evaluations of the two demonstrations lacked comparable data in several key 
areas* Therefore/ the results of this con^arative analysis should be viewed 
more in terms of their contribution to the advancement of methodologies 
designed to cocraare results derived from different evaluations* If more 
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comparable .data had been available from the two evaluation efforts^ it still 
would have been difficult to separate the effects of the differences in pro- 
gram treatments from the effects of the differences in client characteris- 
tics ♦ However r it is much more reasonable to expect that concern for imr- 
proved evaluation would lead to an increase in che comparability of evalua- 
tive data than it is to expect that concern for improved evaluation would 
lead to enhanced incorporation of experimental design within prograxa con- 
cepts • Therefore, a few conclusions and suggestions regarding data compara- 
bility are offered below» 

The present comparisons were handicapped because data concerning student 
background and academic performance or potential were not collected in iden- 
tical form in the ycD and YAP evaluations, and also by the lack of outcome 
data collected in identical fonn» Therefore, DOL should consider establish- 
ing a relatively small set of core background and outcome items that all 
contractors conducting evaluations would be required to include in their 
questionnaires and other, data collection instruments. Although contractors 
would need to supplement these items with items relevant to the purposes of 
the Particular evaluation in question, the common core items always would be 
included. 7o the extent feasible, it should be possible to relate these 
common core items to some nationally representative sample. The presence of 
such a common core of items should produce a much more rigorous, generaliz- 
able "lowest common denominator" of methodology. With such data available, 
the usefulness of the results derived from a comparative methodology such as 
that emplcy/ed here should be enhanced considerably. 
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It is important to note that this suggestion is not intended to support 
imposition of a standardized methodology or data collection battery across 
a variety of program concepts* Rather^ this suggestion is limited to stan- 
dardization of specific key items with appropriately different evaluation 
:aethodologies and data collection approaches* Further, this suggestion is 
not intended as a criticism of past practices* Rather, this suggestion is 
intended as a very modest contribution to the development of evaluation 
strategies for the future which will encompass the considerable diversity of 
program pv^rposes and. processes, on the one hand, and which will provide wider 
opportunities for comparison of results across different evaluations, on the 
other hand* 
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Appendix A 

List of Reports on YAP and YCD Demonstrations 
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Davin, E.P., & Williams, G.D. Study of New Youth Initiatives in 
Apprenticeship; Vol> 1; Summary and Issues > DOL Contract No. 
99-9-2224-33-57. (October, 1981). \ 

Davin, E.P., & Willicims, G.D. Study of New Youth Initiatives in 
Apprenticeship. Vol. 2; Site Visit Reports . DOL Contract Uo. 
99-9-2224-33-57. (October, 1931). 

Williams, G.D., Davin, B.P. , Barrett, B., & Richards, J.M. Jr. Reoort 



on Impacts: Study of New Youth Initiatives in Apprenticeship . DOL 
Contract No. 99-9-2224-33-57. (August, 1981). 

Martin, S.T., Williams, G.D., & Davin, B.P. Apprenticeship - School 
Linkage Implementation Manual . DOL Contract Ho. 99-9-2224-33-57. 
(October, 1981). 

Sducational Test'^Lng Service 

Rock, D., & Preeberg, N.E. Assessment of the Youth Career Development 
Program for School- to- Work Transition: A Phase I Evaluation Demon- 
stration Study . Technical Report #2. DOL Contract No. 27-34-78-04 
(September^ 1930). 
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Rock, D., & Preeberg, N.E. Addendum to Technical Report #2 > DOL 
Contract Mo. 27-34-78-04 (February, 1981). 

Rock, D., & Freeberg, N.E. Assessment of the Youth Career Development 
Program for Schoo l-to-Work Transition: A Phase II Evaluation Demon- 
stration Study . Technical Report #19. DOL Contract No. 
. 27-34-78-04 (January, 1982, [In review by DOL]. 
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